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Abstract. The preferential attachment network with fitness is a dynamic ran- 
dom graph modcL New vertices are introduced consecutively and a new vertex 
is attached to an old vertex with probability proportional to the degree of the old 
one multiplied by a random fitness. We concentrate on the typical behaviour of 
the graph by calculating the fitness distribution of a vertex chosen proportional 
to its degree. For a particular variant of the model, this analysis was first carried 
out by Borgs, Chayes, Daskalakis and Roch. However, we present a new method, 
which is robust in the sense that it does not depend on the exact specification of 
the attachment law. In particular, we show that a peculiar phenomenon, referred 
to as Bose-Einstein condensation, can be observed in a wide variety of models. 
Finally, we also compute the joint degree and fitness distribution of a uniformly 
chosen vertex. 



Keywords. Barabasi- Albert model, power law, scale-free network, nonlinear 
preferential attachment, nonlinearity, dynamic random graph, condensation. 



2010 Mathematics Subject Classification. Primary 05C80 Secondary 60G42, 
90B15 



1 



1 Introduction 



Preferential attachment models were popularized by |BA99j as a possible model for 
complex networks such as the world- wide- web. The authors observed that a simple 
mechanism can explain the occurrence of power law degree distributions in real world 
networks. Often networks are the result of a continuous dynamic process: new mem- 
bers enter social networks or new web pages are created and linked to popular old 
ones. In this process new vertices prefer to establish links to old vertices that are well 
connected. Mathematically, one considers a sequence of random graphs {random dy- 
namic network), where new vertices are introduced consecutively and then connected 
to each old vertex with a probability proportional to the degree of the old vertex. This 
rather simple mechanism leads to networks with power law degree distributions and 
thus offers an explanation for their occurrence, see e.g. |BRST01] for a mathematical 
account. 

There are many variations of the classic model to address different shortcomings, see 
e.g. |Hofl2j for an overview. For example, a more careful analysis of the classical 
model shows that one can observe a "first to market" -advantage, where from a cer- 
tain point onwards the vertex with maximal degree will always remain maximal, see 
e.g. |DM09j . Clearly, this is not the only possible scenario observed in real networks. 
One possible improvement is to model the fact that vertices have an intrinsic qual- 
ity or fitness, which would allow even younger vertices to overtake old vertices in 
popularity. 

Introducing fitness has a significant effect on the network formation. In particular, 
it may provoke condensation effects as indicated in jBBOlj . A first mathematically 
rigorous analysis was carried out in |BCDR07] for the following variant of the model: 
First every (potential) vertex i G N is assigned an independent identically distributed 
(say /^-distributed) fitness J-^. Starting with the network Qi consisting of the sin- 
gle vertex 1 with a self- loop, the network is formed as follows. Suppose we have 
constructed the graph Qn with vertices {1, . . . , n}, then we obtain Gn+i by 

• insertion of the vertex n + 1 and 

• insertion of a single edge linking up the new vertex to the old vertex i € 
{1, . . . , n} with probability proportional to 

J^i degg„(i), (1) 
where degg(i) denotes the degree of vertex i in a graph G- 

In |BCDR07] . the authors compute the asymptotic fitness distribution of a vertex 
chosen proportional to its degree. This limit distribution is either absolutely con- 
tinuous with respect to fi {^^ fit-get-richer phase^^) or has a singular component that 
puts mass on the essential supremum of /i {^^condensation phase^^ or ^^Bose-Einstein 
phase'^). In the condensation phase a positive fraction of mass is shifted towards the 
essential supremum of ^. 

The analysis in [BCDROT] uses a coupling argument with a generalized urn model, 
which was investigated by |Jan04j using in turn a coupling with a multitype branching 
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process. A more direct approach was presented in [Bha07j . who exphcitly couples 
the random graph model with a multitype branching process and then uses classical 
results, see e.g. |JN96j . to complete the analysis. Both results rely very much on the 
particularities of the model specification. This is in strong contrast to the physicists' 
intuition which suggests that explicit details of the model specification do not have 
an impact. 

The aim of the article is to close or at least reduce this gap significantly. We present 
a new approach to calculating fitness distributions, which is robust in the sense that 
it does not rely on the exact details of the attachment rule. In particular, we show 
that the condensation phenomenon can be observed in a wide range of variations of 
the model. 

What makes the preferential attachment model with fitness more difficult to analyse 
than classic preferential attachment models is that the normalisation, obtained by 
summing the weights in ([1]) over all vertices i, is neither deterministic nor is it linear 
in the degrees. 

In the framework of the classical preferential attachment model, there are several ap- 
proaches to specify the model fairly robustly. A rather general approach to calculate 
degree distributions in the case of a constant normalisation is presented in |HW06j . 
where only a (linear) recursion for the degree sequence is assumed. However, the 
approach is restricted to a deterministic out-degree. For a linear model, the require- 
ment of a deterministic normalisation can be relaxed. For example in [CF03] . apart 
from more complicated update rules, the out-degree of a new vertex is also allowed 
to be random (albeit of bounded degree). Similarly, in |Jor06j it is only assumed 
that the out-degree distribution has exponential moments. However, in these cases 
even though the normalisation is random, it is rather well concentrated around its 
mean. A particular interesting variant is when the out-degree is heavy-tailed as anal- 
ysed in [DEHH09] . Here, the fiuctuations of the normalisation around its mean start 
interfering and alter the degree distributions significantly. 

For non-linear preferential attachment models, a particular elegant way of dealing 
with a random normalisation is to establish a coupling with a branching process, 
which implicitly takes care of the problem, see for example the survey |Bha07j . This 
also includes models with sublinear preferential attachment rules, see e.g. |RTV07j . 
A generalisation of the model with fitness is presented in |JorlOj . where the attrac- 
tiveness of a vertex is a function of a random location in some metric space. However, 
in that setting the full analysis is only carried out when the metric space is finite, 
which corresponds to only finitely many different values for the random fitness in our 
model. 

Our approach shows a new way of dealing with the normalisation constant using a 
bootstrapping argument. The idea is to start with a bound 6 on the normalisation, 
from which we deduce a new bound T(9). Then, by a continuity argument, we deduce 
that the correct limit of the normalisation is a fixed point of T. We stress that the 
mapping T is new and has not appeared in the physics literature on complex networks 
with fitness yet. 

In particular, our proofs show that the condensation effect can be observed irrespec- 
tively of the fine details of the model. The phenomenon of Bose-Einstein condensation 
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seems to have a universal character, for an overview of further models see |DM12| . The 
precise analysis of the dynamics in a closely related model are carried out in |Derl3j . 



2 Definitions and main results 

We consider a dynamic graph model with fitness. Each vertex i € N is assigned an 
independent /i-distributed fitness J^i, where // is a compactly supported distribution 
on the Borel sets of (0, oo) that is not a Dirac-distribution. We call fi the fitness 
distribution. 

We measure the importance of a vertex i in a directed graph Q by its impact 

impg(i) := 1 + indegree of i in Q. 

For technical reasons, we set impg(i) = 0, if i is not a vertex of Q. 

The complex network is represented by a sequence {Gn)nen of random directed multi- 
graphs without loops that is built according to the following rules. Each graph Gn 
consists of n vertices labeled by 1, . . . ,n. The first graph consists of the single ver- 
tex 1 and no edges. Further, given Gn, the network Gn+i is formed by carrying out 
the following two steps: 

• Insertion of the vertex n + 1. 

• Insertion of directed edges n + 1 ^ i for each old vertex i £ {1, . . . ,n} with 
intensity proportional to 

•^i -impg^Ci). (2) 

Note that this is not a unique description of the network formation. We still need to 
clarify the explicit rule how new vertices connect to old ones. We will do this in terms 
of the impact evolutions: for each i € N, we consider the process Z{i) = {Zn{i))nm 
defined by 

Zn{i) := impg;,^(i). 

Since all edges point from younger to older vertices and since in each step all new 
edges attach to the new vertex, the sequence {Gn)neN can be recovered from the 
impact evolutions {2{i) : i G N). Indeed, for any i,j,n G N with i < j <n there are 
exactly 

AZj_i{i) := Zj{i) - Zj_i{i) 

links pointing from j to i in Gn- Note that each impact evolution Z{i) is monotonically 
increasing. No-valued and satisfies Zn{i) = l{n=i} for n < i, and any choice for the 
impact evolutions with these three properties describes uniquely a dynamic graph 
model. We state the assumptions in terms of the impact evolutions. For a discussion 
of relevant examples, we refer the reader to the discussion below. 

Assumptions. Let A > be a parameter and define 

1 " 1 
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where := {Zn{i))im- 

We assume that the following three conditions are satisfied: 
(Al) 



(A2) There exists a constant (7™ such that 

Var(AZ„(i)|an) < C7™'-E[AZ„(i)|^„]. 



(A3) Conditionally on for i / j, we assume that AZ„(i) and A2„(j) are 
negatively correlated. 

By assumption the essential supremum of [i is finite and strictly positive, say s. Since 
the model will still satisfy assumptions (Al) - (A3), if we replace Ti by T[ = J-i/s, 
we can and will assume without loss of generality that 

(AO) 

esssup(/u) = 1. 



Remark 2.1. Assumptions (A1)-(A3) guarantee that the total number of edges in 
the system is of order An, see Lemma 13.21 

Let us give two examples that satisfy our assumptions. 

Example 2.2. Poisson outdegree (Ml). The definition depends on a parameter 
A > 0. In model (Ml), given Qn: the new vertex n -t- 1 establishes for each old vertex 
i € {1, . . . ,n} an independent Poisson-distributed number of links n + 1 — )■ z with 
parameter 

TlTn 

Note that the conditional outdegree of a new vertex n + 1, given is Poisson- 
distributed with parameter A. 

Example 2.3. Fixed outdegree (M2). The definition relies on a parameter A € N 
denoting the deterministic outdegree of new vertices. Given the number of edges 
connecting n + 1 to the individual old vertices 1, . . . , n forms a multinomial random 
variable with parameters A and 

^ ^ {j\ 1 ^ 

I — : — % — I I where Tn = - — > Fi Zn(i). 

V XnTn A=i,...,n' An ^ ^ ^ 

" 1=1 

The model (M2) with A = 1 is the one analysed in jBCDROTj . 

We analyse a sequence of random measures (r„)„gN on [0, 1] given by 
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the impact distributions. These measures describe the relative impact of fitnesses. 
Note also that, up to normalisation, Tn is the distribution of the fitness of a vertex 
chosen proportional to its impact. 

Theorem 2.4. Suppose that Assumptions (A0)-(A3) are satisfied. If f ■j^-j' fi{df) > 
A, we denote by 6* > 1 the unique value with 

and set otherwise 6* = 1. One has 

lim = almost surely 

and we distinguish two regimes: 

(i) Fit-get-richer phase. Suppose that f jzrf l^i^f) ^ ^- i^n) converges, almost 
surely, in the weak* topology to T, where 

(a) Bose-Einstein phase. Suppose that f n{df) < X. (r„) converges, almost 
surely, in the weak* topology to T, where 

r{df) = -^fi{df) + (i + x- I -±-,,{df))5i. 

Remark 2.5. In particular, the two phases can be characterized as follows. In the 
Fit-get-richer phase, i.e. if / fi{dx) > A, then the limit of (r„) is absolutely contin- 
uous with respect to /i. However, in the Bose-Einstein-phase, i.e. if f fi{dx) < A, 
then the limit of (Tn) is not absolutely continuous with respect to fi, but has an atom 
in 1. The explanation for this phenomenon is that a positive fraction of newly incom- 
ing edges connects to vertices with fitness that is closer and closer to the essential 
supremum of the fitness distribution fj,, which in the limit amounts to an atom at the 
essential supremum. 

Next, we restrict attention to vertices with a fixed impact /c € N. For n € N we 
consider the random measure 

1 " 

i=l 

representing - up to normalisation - the random fitness of a uniformly chosen vertex 
with impact k. 

To prove convergence of (T^*"'), we need additional assumptions. Indeed, so far our 
assumptions admit models for which vertices are always connected by multiple edges 
in which case there would be no vertices with impact 2. 

We will work with the following assumptions: 
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(A4) Vfc € N: sup,=i,...,„ nP(AZ„(i) > 2|^„) ^ 0, a.s. 

(A4') \/k € N: sup,=i,...,„%„(,)=fc}n|P(AZ„(i) = - ^ 0, a.s. 

Further we impose an additional assumption on the correlation structure: 

(A5) Given the collection {AZn{i)}2^i is negatively quadrant dependent in 
the sense that for any i ^ j, and any A;, Z € N 

P{AZ„(i) < k-AZn{j) < t\Qn} < F{AZ„(i) < k\gn}n^Zn{j) < ^\Qn} 



Remark 2.6. Note that both Examples 12.21 and 12.31 also satisfy these additional 
assumptions. Moreover, under Assumption (Al), Assumptions (A4) and (A4') are 
equivalent to 

(A4") VA; € N: supi=^...,„ nE[AZ„(i)l|AZ„(i)>2}l^n] ^ 0' a.s. 



Theorem 2.7. Suppose that Assumptions (AO), (A4), (A4') and (A5) are satisfied 
and that for some 9* G [1, oo) 

lim Fn = 0* 1 almost surely. 

n— >-oo 

Then one has that, almost surely, {Tn^) converges in the weak* topology to T''"', where 

k—l 

'^ + - J i=i * + T 

The theorem immediately allows to control the number of vertices with impact E N. 
Let 
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n . 
1=1 



Corollary 2.8. Under the assumptions of Theorem 2.1, one has that 

f 1 0^ ^ ^ z 

lim pn{k) = / ^— TT 7f-IJ-{df), almost surely 

^(0,11 fe + ^ / « + y 



Outline of the article 



Section [3] starts with preliminary considerations. In particular, it introduces a stochas- 
tic approximation argument which among other applications also appeared in the 
context of generalized urn models, see e.g. the survey |Pem07j . In preferential at- 
tachment models, these techniques only seem to have been used directly in [JorlOj . 
Roughly speaking, key quantities are expressed as approximations to stochastically 
perturbed differential equations. The perturbation is asymptotically negligible and 
one obtains descriptions by differential equations that are typically referred to as 
master equations. 
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Section [J] is concerned with the proof of Theorem 12. 4[ Here the main task is to 
prove convergence of the random normahsation This goal is achieved via a 

bootstrapping argument. Starting with an upper bound on of the form 

Mm sup ^„ < 9, ahxLost surely, 

n—^oo 

we show that this statement remains true when replacing 9 by 

m = i + ^J ^/Md/). (4) 

Iterating the argument yields convergence to a fixed point. The mapping T always 
has the fixed point 9 = 1. Moreover, it has a second fixed point 0* > 1 if and only 
if / g^fj,{dx) > A, which corresponds to the fit-get-richer phase. In this case, one 
can check that only the larger fixed point 9* is stable. However, in the condensation 
phase, T has only a single fixed point, which is also stable. See also Figure [1] for an 
illustration. 




1 F* " 1 " 

(a) Fit-get-richer (b) Bose-Einstein 

Figure 1: The figure on the left shows the schematic graph of T in the case that 
9* > 1, while the one on the right is for the case 9* = 1. 

Section [5] is concerned with the proof of Theorem 12. 71 The proof is based on stochas- 
tic approximation techniques introduced in Section [3l In our setting these differential 
equations are non-linear because of the normalisation However, since we can 
control the normalisation by Theorem 12.41 in the analysis of the joint fitness and de- 
gree distribution, we arrive at linear equations (or more precisely inequalities) for the 
stochastic approximation. The latter then yield Theorem 12.71 via an approximation 
argument. 



3 Preliminaries 

We first recall the general idea of stochastic approximation, which goes back to jRM51] 
and can be stated for example for a stochastic process X„ taking values in M*^. Then, 
X„ is known as a stochastic approximation process, if it satisfies a recursion of the 
type ^ 

Xn+i — X„ = — F(X„) + Rn+1 — Rn, (5) 
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where F is a suitable vector field and the increment of R corresponds to an (often 
stochastic) error. In our setting, we could for example restrict to the case when is 
supported on finitely many values {/i, . . . , fd} C (0, 1] and denote by 

1 " 

1=1 

the proportion of vertices that have fitness fk weighted by their impact. Then, one 
can easily calculate the conditional expectation of X^+i (k) given the graph Qn up to 
time n. Indeed, as we will see in the proof of Proposition 14.11 under our assumptions 
we obtain that 

E[X„+i(A:) - Xn{k) I Gn] = -^(Mk}) + ^Xn{k) - Xnik)) 

n + l\ Tn ' 

Therefore, we note that Xn = (^n(^))fc=i satisfies 

- Xn{k) = ^— (^({/J) + ^Xn{k) - Xn{k)) + Rn+l{k) - Rn{k), 

so that X„ = (Xn(fc))fc=i satisfies an equation of typeO provided we take Rn+i{k) — 
Rn{k) = Xn-\-i{k) — E[X„+i(/c)|ty„], which defines a martingale, for which we can 
employ the standard techniques to show convergence. 

Provided that the random perturbations are asymptotically negligible, it is possible 
to analyse the random dynamical system by the corresponding master equation 

it = F(xt). 

There are many articles exploiting such connections and an overview is provided 
by |Ben99| . The connection to general urn models is further explained in |Pem07j . In 
random graphs, the resulting differential equation is closely related to what is known 
as the master equation in heuristic derivations, see e.g. [New 101 Ch. 14]. 

However, in our setting, this method is not directly applicable. First of all, we would 
like to consider arbitrary fitness distributions (i.e. not restricted to finitely many 
values) and secondly the resulting equation is not linear, because of the appearance 
of the normalization Fn- The latter problem is addressed by using a bootstrapping 
method (as described in the introduction). However, this leads to an inequality on 
the increment, rather than an equality as in ([5]). Fortunately, the resulting vector 
field F has a very simple structure and so we can deduce the long-term behaviour of 
X„ by elementary means, the corresponding technical result is Lemma |3. II By using 
inequalities, we also gain the flexibility to approximate arbitrary fitness distribution 
by discretization. 

In order to keep our proofs self-contained, we will first state and prove an easy special 
case of the technique adapted to our setting. 

Lemma 3.1. Let (X„)„>o he a non-negative stochastic process. We suppose that the 
following estimate holds 

Xn+l — Xn < —{An — BnXn) + Rn+1 — Rn, (6) 

n + I 

where 
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(i) {An) and (Bn) are almost surely convergent stochastic processes with determin- 
istic limits A, S > 0, 

(ii) {R n) is an almost surely convergent stochastic process. 
Then one has that, almost surely, 

limsupXn < — . 

Similarly, if instead under the same conditions (i) and (ii) 

Xn+\ — Xn > —{An — BnXn) + Rn+l — Rni 

then almost surely 

liminf X„ > — . 

n— >oo B 

Proof. This is a slight adaptation of Lemma 2.6 in |Pem07j . Fix 5 S (0, 1). By our 
assumptions, ahnost surely, we can find no such that for all m, n > no, 

An<{l + 5)A, Bn>{l-6)B, \Rm-Rn\<d. 

Then, by we have that for any m > n > uq, 

m — l 

J 

]=n 

nj-1 (7) 



Xm — Xn < . _^ ^ {Aj — BjXj) + \Rm — Rn 

j=n 

m—l ^ 



3 + 

j=n s 



Let C = |j^|y^. For each index j > hq with Xj > C + 6, one has that 

y. < -B{l-6)6/{j + l). 
Since the harmonic series diverges, by ^ there exists mo > hq with X^o < C + 5. 

Next, we prove that for any m > rriQ one has X^ < C + 36 provided that no is chosen 
sufficiently large (i.e. {1 + S)A < 6). Suppose that Xm > C + 6. We choose mi as 
largest index smaller than m with X^i < C + 6. Clearly, mi > mo and an application 
of estimate ([7|) gives 

X„,<Xm,+Ym,+S<C + 26 + ^-(1 + 6)A<C + 36= || ^ + 36. 

m + 1 (1 — d)B 

Since 6 € (0, 1) is arbitrary, we get that, almost surely, 

limsupX„ < — . 

n— >oo 

The argument for the reverse inequality works analogously. □ 
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As a first application of Lemma 13.11 we can sliow tliat the total number of edges 
converges if properly normalized. 

Lemma 3.2. Almost surely, we have that 

1 " 

lim - S^Znii) = 1 + A. 

n—K>D Tl 

i=l 

Proof. Define = ^ El Li ^n(0- Then, we calculate the conditional expectation of 
Yn+i given Qn using that Zn+i{n + 1) = 1 by definition as 



1 

E[Yn+l\gn] = — + 1) 
Tl -T- 1 . 

1=1 

1 " 

= Yn + — y (1 + Y,n^Zn{i)\gn] " Yn) 

^ i=l 

= Yn + -^{l + X-Yn), 

n + 1 

where we used assumption (Al) on the conditional mean of AZn{i) and the definition 
of Tn- Thus, we can write 

Yn+l-Yn = ^^il + X-Yn) + Rn+l-Rn, (8) 

where we define Rq = and 

ARn := Rn+l — Rn = ~ 

Therefore, Rn is a martingale and Rn converges almost surely, if we can show that 
E[(Ai?„)^] is summable. Indeed, first using (A3) which states that impact evolutions 
of distinct vertices are negatively correlated, we can deduce that 

1 " 

E[iARnf\gn] < — — -2 (VE[(A^„(i) -E[A^„(i)|^„])2|g„] + 1) 
(n + 1 r 



(n + l)2 



i=l 

n 



(n + Ij^ 

which is summable. 

Hence, we can apply both parts of Lemma l3 . 1 1 together with the convergence of (Rn) 
to obtain the almost surely convergence lim„^oo Yn = I + X. □ 

Later on, we will need some a priori bounds on the normalisation sequence. 
Lemma 3.3. Almost surely, we have that 

/X liidx) < liminf -Fn < lim sup -Fn < 1 + A. 
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Proof. For the lower bound, notice that by definition Zn{i) > 1, and therefore 
Hminf— > > hminf — > J~i = / xiiidx). 

n— ^oo 77, ■'^ — ' n— i-oo n ' / 
i=l i=l 

Conversely, one can use that the J~i ^ 1 and combine with limn— >.oo ^ X^j=i ^nii^ — 
1 + A, see also Lemma □ 



4 Proof of Theorem 12.41 

The central bootstrap argument is carried out at the end of this section. It is based on 
Lemma 14.21 Before we state and prove Lemma l4.2[ we prove a technical proposition 
which will be crucial in the proof of the lemma. 

Proposition 4.1. (i) Let 9 > 1. If 

limsup^n < 9, almost surely, 

n—^oo 

then for any < a < b < 1, one has 



1 " f 
liminf- Vl|^^g( b]}imp„(i) > / 



Kdf), 



almost surely, 
(ii) Let 9>0. If 

liminf Tn > 9, 

then for any 0<a<b<9Al, 

r ft 

■Kdf). 



1 f 
limsup- < / 



b]0-f 



Proof, (i) First we prove that under the assumptions of (i), one has for < / < /' < 1, 
that 

1 " 9 
liminf - V > fi{{f, /']), almost surely. (9) 

i=l •' 

Let </</'< 1 and denote by 

x. = r„((/,/']) = -^z„(i), 



n 



where we denote by I„ = {f G {1, . . . , n} : J^j G (/, /']}. 

We will show ([9]) with the help of the stochastic approximation argument explained 
in Section [3l see Lemma 13.11 We need to provide a lower bound for the increment 
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Xn+i — Xfi. Using assumption (Al), we can calculate the conditional expectation of 



[Xn+llQn] = -^Y^^iZn+MGn] + -^FiJ'n+l G (/,/']) 

2 Gin 

= + ( E n^Zn[i)\Gn] -Xn + ^((/, /'])) 



Hence, rearranging yields 



E[X„+i|g„] -Xn> ^ (//(/,/'] - (1 ^-^)Xn) 

n + 1 V sup^>„ Fm 

Thus, we can write 

Xn+l — Xn> — - (^(/i /'] ~ (l ~ — :^)Xn) + Rn+1 — Rn, 

n+l\ SUp^>„ Frn 

where Rn is a martingale defined via Rq = and 

ARn := Rn+l — Rn = Xn+l — E[Xn+l\Gn\- 

If we can show that i?„ converges almost surely, then Lemma 13.11 together with the 
assumption that lim sup„__^oo -^n < ^ shows that 

liminfX„>-^Ma/']), 

which is the required bound 

The martingale convergence follows if we show that KKARnflGn] is summable. In- 
deed, 

The second moment of the last expression is clearly bounded by f^^^^-ji /^((/; /']) which 
is summable, so we can concentrate on the first term. Now, we can use (A3), the 
negative correlation of AZ„(i), and then (Al) and (A2) to estimate the variance to 
deduce that 



— [ ( ^ (Z„+i (i) - E[Z„+1 (i) )) 

(n TW^ii E(^^"W - E[A^n(^)|en])) V" 

1 

(n + l)2 



< 



1 ..-^ T -7 1 



(„ + l)2^ A. - (n + l)2^ ^' 
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where we used the definition oi Tn in the last step. The latter is obviously summable, 
so that Rn converges almost surely. 

Note that the assertion (i) follows by a Riemann approximation. One partitions (a, h] 
via a = fo < ■ ■ ■ < fi = b with an arbitrary £ € N. Then it follows that 

1 " ^"^0 
liminf- V]l{jr^5:(a,b]}imp„(i) > V- :r KifkJk+i]), almost surely, 

i=l k=0 •' 

and the right hand side approximates the integral up to an arbitrary small constant, 
(ii) It suffices to prove that for </</'< ^ A 1 one has 

1 " 9 
limsup - ^ l{J^,e(/,/']} ^n{i) < ^ _ p /'])' almost surely. (10) 



n^oo II' ■ , " ~ J 



This follows completely analogous to part (i) using Lemma l3. II Then the statement 
(ii) follows as above by a Riemann approximation. □ 

The next lemma takes the lower bound on the fitness distribution obtained in Propo- 
sition HTT] to produce a new upper bound on the normalisation. We set for 9 >! 

Lemma 4.2. (i) Let 9 > I. If 

limsup^n < 9, almost surely, 

n— >oo 

then 

limsup.F„ < T{9), almost surely, 



(ii) Let 9 > and suppose that 



liminf > 9, almost surely. 

n— >oo 



One has, almost surely. 



liminf J-'n > 

n— >oo 



T{9) if9>l, 
^+|(1_^[O,0)) ^/^G(0,l) 



Proof, (i) Define a measure v on [0, 1) via 



^idf) = j-jf,{df). 



Further, set v' = i/+((l+A)— z/[0, l))(5i. Since by Lemma l3.2l lim.„^oo ^ ^1^=1 ^nii) 
1 + A, almost surely, we get with Proposition 14. II that, for every t G (0, 1), 

1 " 

limsup — l^jr.fz^^ i^yZnji) < 1 + A — z^([0, t)) = u\[t,l]), almost surely. 
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This allows us to compute a new asymptotic upper bound for {J-n)'- let m G N, 
observe that, almost surely, 

^ n 1 " 1 

i=l i=l j=0 

m— 1 ^ n 



Am n 

j=0 1=1 



so that 



^ m—l 

limsup^n < - — > z^'fh'/m, 1]), almost surely. 



Am 



The latter expression tends with m — > oo to the integral \ j x v'{dx) and we finally 
get that, almost surely. 



limsupJ-„ < \ f fu'{df)=T{e). 



(ii) Let 0' G (0,0 A 1) and consider the (signed) measures u = ^{0') and z^' = i/'(0') 
defined by 

and 

I/' = + (1 + A - z^[0, 
As above we conclude with Proposition 14. II that for t < 9', almost surely, 
n 

liminfVV,6(i,i]}2n(0 >l + X-iymt])=iy'{{t,l]). 

i=l 

We proceed as above and note that for any m € N, 

^ n 1 " 0' 

i=l i=l i=l 

j=l 1=1 
which yields that, almost surely, 

B' ^ 

n— >oo Am ^ — ' 

i=i 

Since m € N is arbitrary, we get that, almost surely, 

iiminfj-„>i / fu\df) = \(e'{i + \)-e [ ^:i/^(d/)). 
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We distinguish two cases. If ^ < 1, we use that the latter integral is dominated by 
Hi[0,0']) and let 6*' t 6* to deduce that 

Q 

liminf Tn > ^ + -r(l ~ /^[^i almost surely. 

n— ^oo X 

If 6* > 1, we let e' t 1 and get 

lim^infJ-„>i J fj,'(df) = j(l + X-9 Jl^^,{df)^=T{e). 

□ 

Finally, we can prove Theorem 12.41 where we first show the normalisation converges 
using a bootstrap argument based on Lemma 14. 2[ Finally we use the bound on 
the fitness distribution obtained in Proposition 14.11 to show convergence of fitness 
distributions. 

Proof of Theorem \2.4\ (i) Fit-get-richer phase. Suppose that 9** is the smallest value 
in [9*, oo) with 

limsup.F„ < 9**, almost surely. (12) 

n— )-oo 

Such a value exists due to Lemma 13.31 We prove that 9** = 9* by contradiction. 
Suppose that 9** > 9*. We apply Lemma liT2] and get that 

limsup.F„ < T{9**), almost surely. 
Now note that T is continuous on [9*, 9**] and differentiable on {9*, 9**) with 

Further 9* is a fixed point of T. Therefore, by the mean value theorem, 

T{9**) = T{9*) + T'{9){9** - 9*) < 9** 

for an appropriate 9 € {9*, 9**). This contradicts the minimality of 9**. 

We now turn to the convergence of the measures r„. Note that the measure F defined 

by 

ndf) = ^Kdf) 

has total mass 1 + A. Since r„(0, 1) = ^ J2i^=i ^n{i) tends to 1 + A, almost surely, 
one can apply the Portmanteau theorem to prove convergence of (F„). Let V = 
UneN 2~"Zn [0, 1] denote the dyadic numbers on [0, 1]. We remark that the number of 
dyadic intervals (a, b] with endpoints a,b £ V is countable so that, by Proposition 14. H 
there exists an almost sure event Oq, such that for all dyadic intervals (a, 5] 

liminf r„(o, 6] > F(a, 6] on Oq. 

n->oo 
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Let now U C (0, 1) be an arbitrary open set. We approximate U monotonically from 
within by a sequence of sets {Um)meN with each Um being a union of finitely many 
pairwise disjoint dyadic intervals as above. Then, for any m € N, one has 

liminf r„(C/) > liminf r„([/m) > r(C/m) on Qq 

n— ^oo n— >oo 

and by monotone convergence, it follows that liminf„_j>oo r„([/) > T{U) on Qq. This 
proves convergence 

r„ r, almost surely. 
Since = j f /r„(d/), we conclude that, almost surely, 



hm Tn = \ I fT{df) = 9*. 



(a) Bose-Einstein phase. Let 9* = 1. We start as in (i). Let 0** denote the smallest 
value in [1, oo) with 

limsup-F„ <9**, almost surely. 

n— )-oo 



As above a proof by contradiction proves that 9** = 1. Next, let 9** denote the 
largest real in (0, 1] with 

liminf ^„ > 9**, almost surely. (13) 

n— >oo 

By Lemma 13.31 such a 9** exists and we assume that 9** < 1. By Lemma 14.21 the 
inequality p3|) remains valid for 

9** + fi[0,9**)) >9** 

contradicting the maximality of 9** . Hence, 

lim = 1) almost surely. 

n— >oo 

By Proposition 14.11 one has, for < o < 6 < 1, 

liminf r„(a, 6] > / fi{df) = r{a,b], almost surely, 

Jia,b] 1 - J 

and, for < a < 6 = 1, 

liminf r„(a, 1] = 1 + A — limsupr„(0,a] = T{a, 1], almost surely. 

n— >-cxD n— >oo 

The rest of the proof is in line with the proof of (i) . □ 
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5 Proof of Theorem 12.7 



The proof is achieved via a stochastic approximation technique as discussed in Sec- 
tion [3l 



Proof of Theorem 2.1 . We prove the statement via induction over A; = 1, 2, ... . The 
proof of the initial statement (k = 1) is similar to the proof of the induction step and 
we will mainly focus on the latter task. 

Let k E {2, 3, . . . } and suppose that the statement is true when replacing /c by a value 
in 1, . . . , A; - 1. We fix /, /' e [0, 1] with ^({/, /'}) = 0, ^((/, /']) > and consider 
the random variables 

x„:=r<'^)((/,/']) 

for n G N. In the first step we derive a lower bound for the increments of that 
is suitable for the application of Lemma 13.11 

We restrict attention to vertices with fitness in (/, /'] and denote := {i G {1, . . . , n} : 
e (/,/']}• Note that 

1 ^ 



+ E (E i{2„w=/}i'(A^n(i) = k - i\g„ 



(14) 



i&„ 1=1 



t{z,4i)=k}n^Zn{i) / 0|g„) 



n + 1 



An application of the induction hypothesis gives that for fixed / G {1, . . . , A; — 1} 

k-1 



i™o E kZnii)=l}n^Mi) =k- llQn) = t{l=k^l} 



almost surely. Indeed, for Z = A; — 1 



|E%nw=fc-i}ip(^^-(^) = i|^-) 



A;- 1 



^ 7 



n J{f,f'] 



if J'] 



xdr("-^'(dx) 



< sup l|2„(,)=,,_i}nP(AZ„(i) = l|g„)-^^^^ 

1=1,. ..,n ^ n 



+ 



A;- 1 



ifJ'] 



xdY^^-'^dx] 



and the former term tends to zero due to assumption (A4') and the latter term tends 
to zero by the induction hypothesis (and the fact hat F^'^"^^ puts no mass on / and 
/'). Analogously, one verifies the statement for the remaining /'s invoking assumption 
(A4). Further one has that 



J2kznii)=k}m24^) / 0) - ^X., 

•J n 



J~ik 



+ sup nP(A2:„(i) >2\g„ 

i=l,....n 
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where the two terms on the right hand side converge to by assumptions (A4) and 
(A4'). 

Consequently, there exist stochastic processes {An) and (i?n) such that 

— Xn > ^ _|_ i^n — BnXn) 

with An — )• /(//'] X dT'-''^^^ (x) and fi„ — > 1 + almost surely (where the former 
limit is positive since fi{{f,f']) > 0). We now choose (Rn) as the martingale with 



Rn = ^{Xk-nXk\gk-i]), 



k=l 

where we define Go as the empty graph and observe that 

Xn+l — Xn > —r{An — BnXn) + Rn+1 — Rn- (15) 

n + 1 

Convergence of the remainder term. Next, we prove that {Rn) converges almost 
surely. An elementary calculation shows that the process {Rn) is the difference of two 
martingales, namely 



and 



both starting in 0. Since both martingales are the same up to a shift of parameter 
k, we only have to show that either converges almost surely for fixed /c € N. We will 
show that M*^' converges by showing that its quadratic variation process converges 
almost surely. Indeed we will show that E[(AM4^')^|^„] is almost surely summable, 
where AM4" = M!^1^ - M}^\ 

First using assumption (A5), i.e. the conditional negative quadrant dependence of 
AZn{i), we find that 



E[(AM(^')2|6;„] 

- (n + 1)2 ^[{hzn[i)<k,Zn+iii)>k} - ^{2n{i) < k,Zn+i{i) > kjlGr 



2 

0n 



^ JWTl)^ hZnii)<k}n^Zn{t) > MQn) 

^"^^^^ ^&n 



1 

< 



where we used the definition of Tn in the last step. By assumptions (A4) and (A4') 
the latter expression is indeed almost surely summable. 



19 



Completing the induction step. Combining the convergence of the remainder term Rn 
with the recursion in (jl5|) , it follows with Lemma 13.11 that 

hm^inf r«((/, /']) > ^ yi.f, (17) 

Recall that /, /' G [0, 1] were chosen arbitrarily with f < f and fi{{f,f'}) = 0, where 
we can drop the assumption that /u((/, /']) > 0, since the statement holds trivially in 
that case. We now pick a countable subset F C [0, 1] that is dense such that for each 
of its entries / one has = 0. The above theorem shows that there exists an 

almost sure set J^o on which ()17p holds for any pair f,f'(^¥ with / < /'. Suppose 
now that U is an arbitrary open set. By approximating the set U from below by 
unions of small disjoints intervals (/, /'] with f,f'(z¥ it is straight-forward to verify 
that 

liminf rW(;7) > (A: - 1) / , ^, dV^'-'^x) 

on Oq. The proof of the converse inequality, namely that almost surely, for any closed 
A, one has 

hm sup r(f ' {A)<{k-l) ( dV^-^-'^ ix) 

is established in complete analogy. We thus obtain that r^*"^ converges almost surely, 
in the weak*-topology to r'*"^ given by 

1=2 



Initialising the induction. To complete the argument, we still need to verify the 
statement for the initial choice k = 1. We again define = Tn *((/,/']) for /, /' G 
[0,/] with = 0, fiifj'] > and we define I„ = {i G {1, . . . , n} : 7"^ G 

(/, /']}. Then, it follows that since Zn+i{n + 1) = 1 by definition, 

E[Xn+l\gn] = V nZn+1 = MGn) + -^Fi^n+l G (/, /']) 

n + 1 ^-^ n + 1 

= X„ + ^ [ l{Z„»=l}^(A^n+l > \\Qn) - + /'])" ■ 

Thus, in complete analogy with the induction step, one can show that 

n + 1 

where fi{{f,f']) and Bn ^ 1 + ^ and Rn+i - Rn = ^n+i - IE[X„+i|^„]. 

The remainder term Rn can then be decomposed as Mn^ — Mn^ + /„, as above with 
M^n^ = 0, defined as in (jl6p and the additional term defined as 
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We have already seen that M^^^ converges. Moreover, an elementary martingale 
argument (for i.i.d. random variables) shows that In also converges almost 

surely. Therefore, by Lemma l3. II we can deduce that 

liniinfX„>-^M(/,/'])- 

n^oo a -\- J 

Repeating the same approximation arguments as before, we obtain that F^^' converges 
almost surely in the weak* topology to F*^' given by 

r(^'(dx) = -^^Ji{dx), 

which completes the proof by induction. □ 
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